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ABSTRACT 

5_i ■ This note presents an analytic construction of the optimal unit-norm direction x = x/||x|| 
that maximizes or minimizes the objective linear expression, B ■ x, subject to a system 
of linear constraints of the form [A] ■ x = 0, where x is an unknown n-dimensional real 
vector to be determined up to an overall normalization constant, is an m-dimensional 
null vector, and the n-dimensional real vector B and the m x n-dimensional real matrix [A] 
(with < m < n) are given. The analytic solution to this problem can be expressed in 
terms of a combination of double wedge and Hodge-star products of differential forms. 
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1 Introduction 



A basic problem in linear programming [T] is the optimization of the objective function, 
B ■ x, which is linear in an n-dimensional real vector x, with non-negative components, 
that is subject to a system of linear constraints of the form [A] ■ x = Ao, where [A] is an 
m x n-dimensional real matrix, with < m < n, and Ao is an m-dimensional real vector 
with non-negative components. 

This note presents an exact, analytic solution to a simple, but different class of linear 
programming problems, where A is the m-dimensional null vector and the objective 
is B • x, where x = x/||x|| is the optimal unit-norm direction to be determined. In the 
absence of any linear constraint (m = 0), the solution is trivially given by x = B/||B|| = B. 
For a large number m of linear constraints, however, the solution becomes non-trivial and 
relies on a geometric construction expressed in terms of wedge and Hodge-dual products 
of differential forms (2H3]- 

As an example of this type of linear programming problem, this note first describes 
the simple case involving a single constraint A ■ x = on a 3-dimensional real vector x. 
The subspace of parameters satisfying such a linear constraint is characterized, and the 
analytic construction of a real vector x that optimizes the linear expression, B • x, is then 
described. Subsequently, a generalization to multiple constraints in higher-dimensional 
spaces is described. We emphasize the formal analogies between the three- and higher- 
dimensional cases. 

2 A Three-Dimensional Example 

Let us first consider a simple three-dimensional (3D) example, where x = (xi, X2, £3). 
Using the standard notation of inner product multiplication between vectors, the aim is to 
find the unit-norm direction x = x/||x||, along which the expression, B • x, is maximized 
or minimized, subject into the constraint: A ■ x = 0, where the three-vectors A and B are 
given. 

As represented schematically in Fig. [T], the solution to this problem is well known and 
is given by the ordinary vector triple product: 



where t G 1R is an arbitrary real parameter. Evidently, the optimal (maximal) direction is 
given by the unit-norm vector, 





x = 




(2.2) 
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Figure 1: Three dimensional example that illustrates the geometric construction of the 
optimal direction for B • x, subject to the constraint A ■ x = 0. The optimal direction is 
given by the vector x(i), which is the intersection of the indicated plane perpendicular to 
the vector A with the plane defined by the vectors B and A. 



provided that A x B / 0, i.e. the 3-vectors A and B are not parallel to each other. If A 
and B are parallel, the solution is not unique, given by x = A x N/||Ax N||, where N is 
an arbitrary 3-vector non-parallel to A or B, i.e. N-A^O. In this case, the unit-norm 
vector x lies on a plane perpendicular to both A and B, and B • x = 0. 

If A and B are not parallel to each other and the norm of the vector x(t) is fixed to 
be ||x(t*)|| = R at t = t* > 0, then the largest value of B • x at radius R is determined by 



B ■ x(t<,) = t* ||A x B| 



lAiniBl 



fA B] 



(2.3) 



Likewise, the minimum of B ■ x at radius R occurs at t 



3 A Higher-Dimensional Analytic Construction 

The above geometric construction for the 3D example can be generalized to higher dimen- 
sions, where B is an n-dimensional real vector and [A] is an m x n-dimensional real matrix 
(with < m < n) that imposes a number m of real constraints on the n-dimensional real 
vector x through the condition [A] ■ x = 0, with being the null vector in m dimensions. 

Our analytic construction proceeds along the lines of the 3D example. In detail, in 
analogy to the 3D vector A, we define the m-form A^ m ) through the m-fold exterior or 
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wedge product: 

(A (m) ) Q , lQ , 2 ... Qm = (Ax A A 2 A . . . A m ) aia2 ... am = A[ lai A 2ct2 . . . A mctm ] , (3.4) 

where the Greek indices ai,2,...,m = 1,2, ... ,n label the columns of the m x n-dimensional 
matrix [A] = (A 1; A 2 , . . . , A m ) T . The square brackets on the RHS of (j3.4p indicate that 
the m-rank tensor (A^ m ^) Q , lQ , 2 ... Q , m = A aia2 ,, Mm is fully antisymmetrized in all Greek indices, 
entailing that A^ m ^ is an m-form. 

Correspondingly, the analogue of the direction A x B, which determines the normal 
to the plane defined by A and B in the 3D example of Section 2, is the (n — m — l)-form: 

)ti'Y2— 7(n-m-l) = E on^2---OL m P"ii^2---"l{ n -m-i) ^0^02. ..a m Bp 1 (3-5) 

where summation over repeated indices is implied and £ Ql a 2 ... Qmi 3 7l72 ... 7(n _ m _ 1) is the usual 
fully antisymmetric Levi-Civita tensor generalized to n dimensions. In the language of 
differential forms, (C( n_m_1 ^) 7l72 ... 7(n _ m _ 1) = C 7l72 ... 7(ji _ m _ 1) is, up to an irrelevant over- 
all factor, the Hodge-dual product between the 1-form (B^)^ = Bp, representing the 
components of the n-dimensional real vector B, and the m-form AS m \ i.e., 

c (n-m-l) = ^/ B (l) A A (m)\ ? (3 ^ 



where * denotes the standard Hodge-star operation [HJH] applied within the entire n- 
dimensional vector space. 

The components x a of the optimal n-dimensional real vector x are given by the 
Hodge-dual product of the m-form (A( m )) aiQ , 2mQlm = A aia2 ,, Mm and the (n — m — l)-form 
( C(n_m_1) )7i72...7(„- TO -i) = C, 7i72...7(„- m -i)> which is the 1-form: 

%a{t) — t £aai«2— Om717a—7(n-m-l) ^ a i a 2- a m ^7i72---7(n-m-i) 

— t E aaiot2 ___ C* m7 l 7 2... 7 ( n _ m _l) ^/ 3 / 3 l/ 3 2---/3m7l72---7(n-m-l) 

x A lai A 2a2 ■ ■ ■ A moim Bp A\p x A 2 p 2 . . . A m p m , (3.7) 

where t and t' are arbitrary real parameters. Equation (13.71) represents the central result 
of this note, and can be equivalently cast into the more compact form: 

x(t) = t' ^A^AC^" 1 " 11 ) = t *[A (m) A *(b (1) A A (m) )] . (3.8) 

We emphasize the complete analogy between the general solution given by the RHS of (13.81) 
and the 3D result of (TO) . 

By construction, the n-dimensional 1-form vector x a (t) = x a (t) satisfies the linear 
system of constraints: [A] ■ x = 0. Within a fixed given radius ||x(t*)|| = R at t = t* > 0, 
the maximum value of B • x(£*) is given by 

B ■ x(t*) = £ aQ !iQ!2-a!m7l72— 7(»-m-l) £ PPlh—Pmll^2—1{ n -m-l) 

x B a Ai ai A 2a2 . . . A mam Bp A 1 p 1 A 2 p 2 . . . A m p m . (3.9) 
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The minimum value is obtained correspondingly as t — — t*. Obviously, a non-zero value 
for B • x(t*) is obtained, iff the n-dimensional vectors Ai ai , A 2a2 , ■ ■ ■ , A mctm and Bp are all 
linearly independent of each other. 

Proof. We now present a simple proof of the analytic construction given in Eq. (13.91) . To 
this end, we consider the non-trivial case, where the n-dimensional vectors Ai ai , A 2a2 , . . . , 
A mam and Bp span a non-degenerate (m + l)-dimensional subspace. Consequently, a linear 
transformation represented by the m x m matrix [R] can be performed on the left of the 
m x n-dimensional matrix [A], i.e. [A'] = [R] • [A], such that [A'] • x(£*) = and A' ka A' la = 
const. Ski, with k,l = 1,2, ... ,m. Specifically, this linear transformation exemplifies the 
usual Gram-Schmidt approach [5] to orthogonalizing a set of m linearly- independent vectors 
which span the same m- dimensional subspace as the original vectors. In addition, the 
complete n-dimensional space can be rotated by an orthogonal transformation, i.e., x(t*) — > 
x'(£*) = [O] ■ x(£*), without affecting the norm of all n-dimensional vectors, such that 
A'l a = cikSka- Here, a& are positive constants that give the norms of the orthogonalized 
vectors A'^ which are equal to those of the orthogonally-rotated ones A''^. In this linear 
basis, only the components of Bp lying in the complementary dimensions m + 1, m + 2, . . . , n 
give a non-zero contribution in Eq. ( 13 . 91) . If we denote this orthogonally projected vector 
with Bp, the linear expression B • x(£*) becomes 

m n 

B-x(t,) = UHal £ {B^f . (3.10) 

k=l a=m+l 

This represents indeed the largest value for the above linear expression. Note that the 
optimal direction x(i) is parallel to the reduced vector: B^. 

4 Conclusions 

The problem studied in this note deals with a specific class of problems within the wider 
context of linear programming. It has been shown that the optimal unit-norm direction x 
of the objective B • x, subject to a system of linear constraints of the form [A] • x = 0, is 
given by (13. 7p . where [A] is an m x n-dimensional real matrix. In particular, the optimal 
solution can be expressed in terms of wedge and Hodge-dual products of differential forms, 
as stated in ( 13. 81) . The latter provides an explicit geometric connection of the 3D result 
in ( 12. ip with the general n-dimensional solution given in ( I3.8j) . 

A straightforward extension of the problem studied in the present note would be to 
consider a complexification of the constraints, i.e., [A] is an m x n complex matrix, in which 
case x is a complex n-dimensional vector. Such an extension makes sense if the objective 
is a real number, e.g., the real or imaginary part of the expression B • x. This problem can 
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be solved along the lines of the presented method, where x is treated as 2n-dimensional 
real vector and turning the complex m x n matrix [A] into a 2m x 2n real matrix. 

The present geometric solution may suggest the existence of a more profound con- 
nection between differential forms and linear programming, beyond the limitations of the 
specific problem under study. It may therefore be interesting to pursue this direction of 
mathematical research in linear programming with greater vigour in future. Likewise, it 
would be interesting to explore the potential applications of this geometric solution to a 
plethora of problems related to physics [6], computer science, engineering, biology, actuarial 
science and economics. 
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